Freddie Brown was born in Austin, Texas. He was raised up in two small central Texas towns of Lometa and Goldthwaite. Freddie's late mother Oma Cole had raised her children, Freddie, Joan, and Pat as a single parent. Freddie being the youngest and the only boy. Oma had first noticed Freddie's singing talent at The First Baptist Church in Lometa, where Freddie would sing with the choir on Sundays. Freddie would make believe an old broom was his guitar and pretend that he was Elvis Presley which Oma would get a kick out of.